Robotics  Research 
Technical  Report 


,^#! 
1^^ 


^ 


Ki;» 


Sl 


»r*^'i 


Control  of  Multifinger  Manipulation: 
heoretical  and  Experimental  Studies  Using  a  Planar  Manipulator 

by 

J.  Demmel,  G.  Lafferriere,  J.  Schwartz,  M.  Sharir 


I 


Technical  Report  No.  329 

Robotics  Report  No.  126 

October  1987 


\ 


g 
3  e 

S  Q 


14-1   4-1 
O    (0 

rH 
■r-i     D 

O  CU 
U  -H 
4-1  C 
C    (0 

o  e 


New  York  University 
Institute  of  Mathematical  Sciences 

Computer  Science  Division 

25 1  Mercer  Street   New  York,  N.  Y  1 00 1 2 


Control  of  Multifinger  Manipulation: 
Theoretical  and  Experimental  Studies  Using  a  Planar  Manipulator 

by 

J.  Demmel,  G.  Lafferriere,  J.  Schwartz,  M.  Sharir 


Technical  Report  No.  329 

Robotics  Report  No.  126 

October  1987 


New  York  University 

Dept.  of  Computer  Science 

Courant  Institute  of  Mathematical  Sciences 

251  Mercer  Street 

New  York,  New  York    10012 


Work  on  this  paper  has  been  supported  by  Office  of  Naval  Research  Grant  N00014-82-K- 
0381,  National  Science  Foundation  CER  Grant  DCR-83-20085,  and  by  grants  from  the  Digi- 
tal Equipment  Corporation  and  the  IBM  Corporation. 


Abstract 

We  present  an  approach  to  manipulation  tasks  involving  dextrous 
hands.  This  approach  treats  the  gripped  object  as  a  virlual  finger 
and  henceforth  reduces  the  description  of  the  task  objectives  to  the 
computation  of  target  forces  and  torques  at  reference  points  on  the 
object.  Computations  are  carried  out  for  the  case  of  three  fingers 
holding  a  planar  object.  We  implemented  these  ideas  on  the  Four 
Finger  Manipulator  at  NYU.  Experimental  results  are  presented  for  a 
door  opening  and  a  wall  following  task.  Future  plans  for  research  with 
the  Utah/MIT  dextrous  hand  are  outlined. 
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1      Introduction 

This  paper  treats  the  problem  of  coordinating  finger  motions  in  dextrous 
manipulation.  This  problem  is  part  of  the  more  general  problem  of  motion 
and  control  of  systems  containing  closed  kinematic  chains.  Other  examples 
of  robotics  systems  containing  such  chains  are: 

1.  multileggcd  InrnmoliDn  sysloms  whore  two  or  more  legs  toiirli  the  floor 
Rimullaiiooiisly  (tlii'  (■h;\iiis  are  rioKod  througli  tlio  grnniul), 

2.  multiple  manipulator  syslcin.s  (the  cliains  arc  closed  lliiougli  the  load). 

One  of  the  main  problems  in  the  control  of  systems  with  closed  kinematic 
chains  is  the  distribution  of  forces  within  the  mechanism.  In  the  case  of 
dextrous  manipulation  the  active  control  of  such  distribution  of  forces  is 
necessary  in  order  to  avoid  either  crushing  a  gra.sped  object  or  losing  a  grip. 

We  present  a  closed  loop  control  strategy  dealing  with  the  distribution 
of  forces  among  several  independently  controlled  fingers  manipulating  an 
object  being  held  in  a  fixed  grip.  Our  approach  treats  the  grasped  object  as 
a  virtual  finger  allowing  forces  on  and  positions  of  the  object  to  determine 
positions  and  forces  for  the  individucil  fingers.  The  transformations  involved 
are  linear  and  can  be  computed  once  the  grip  is  established  and  need  not 
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be  recomputed  unless  the  gripping  points  change.  That  is,  wc  can  set  target 
positions  and  forces  for  the  object  depending  on  the  task  to  be  accomplished 
and  by  applying  the  appropriate  transformations  obtain  the  targets  for  the 
individual  fingers.  The  gripping  forces,  which  depend  on  the  coefficients  of 
friction  at  the  gripping  points,  are  chosen  by  defining  some  suitable  point  of 
concurrence  for  the  finger  forces. 

While  some  of  the  ideas  discussed  here  generalize  to  other  systems  con- 
taining closed  kinematic  chains,  some  are  specifically  suited  to  dextrous 
manipulation  problems.  For  instance,  inertial  factors  are  generally  negligi- 
ble when  dealing  with  dextrous  hands  with  small  and  light  fingers,  but  could 
be  significant  in  larger  robots.  The  motions  of  fingers  are  small  and  hence 
a  'linearized  analysis'  is  suitable.  Also,  power  consumption,  which  will  not 
be  significant  when  dealing  with  fingers,  may  imply  a  cost  criterion  which  is 
important  in  the  case  of  robot  arms  or  locomotion  systems. 

We  have  implemented  the  ideas  to  bo  described  on  the  NYU  experimen- 
tal Four  Finger  Manipulator  (henceforth  referred  to  a.s  FFM).  The  FFM 
is  a  simple  planar  manipulator  consisting  of  four  independently  controlled 
fingers  equipped  with  position  and  force  sensors.  Several  tasks,  including 
the  following,  wopo  stiidicil  I'xprriiTioiitiilly. 

i.  Grasp  a  rigid  object  and  move  it  in  free  space. 

ii.  Hold  the  knob  of  a  2-dinicnsional  'door'  and  pull  the  door  open  (with 
and  without  external  forces  acting  on  the  door).  In  this  task,  the 
position  of  the  hinge  with  respect  to  the  doorknob  is  unknown. 

iii.  Hold  a  'tool"  and  follow  a  wall  with  it  (keeping  the  tool  at  a  prescribed 
angle  to  the  wall),  while  exerting  a  constant  normal  force  on  the  wall. 
The  shape  of  the  wall  is  unknown. 

Section  2  introduces  some  notation  related  to  motions  of  rigid  bodies  and 
multifinger  grasping.  Section  3  gives  a  broad  description  of  our  approach 
and  analyzes  several  typical  manipulation  problems.  Section  4  reviews  the 
related  literature.  Several  detailed  computations  are  presented  in  Section  5 
and  a  more  detailed  description  of  the  FFM  is  given  in  Section  6.  We  report 
on  the  experimental  results  in  Section  7.  Finally  in  Section  8  we  discuss  plans 
for  study  of  the  Utah/MIT  dextrous  hand  as  they  relate  to  our  current  work. 
Appendix  A  describes  the  kinematic  structure  of  the  FFM  in  detail. 


2      Definitions  and  Notation 

The  following  terminolog>'  is  standard  (see  [34],  [4],  [15]).  Let  {A}  denote 
a  fixed  reference  frame  with  axes  x^'Va-'^a-  Given  a  rigid  body  in  B? . 
let  {5}  be  a  coordinate  frame  attached  to  it  with  axes  xb^VB-^B-  The 
configuration  of  a  rigid  body  in  3-dimensional  space  {R^}  can  be  described 
by  the  position  and  orientation  of  the  body  frame  {B)  with  respect  to  the 
reference  frame  {.4}  (["]).  The  space  C  of  all  configurations  of  the  rigid  body 
is  a  6-dimensionaJ  manifold  which  can  be  parametrized  using  Euler  angles 
and  cartesian  coordinates.  In  the  case  of  a  planar  object  the  configuration 
space  is  3-dimensioneJ  and  can  be  parametrized  by  one  angle  (the  ajigle  of 
rotation  of  the  body  coordinate  frame  with  respect  to  the  reference  fratme), 
and  the  cartesian  coordinates  of  the  origin  of  the  body  frame  with  respect 
to  the  reference  frame.  Given  a  configuration  c  of  the  rigid  body  the  set  of 
all  generaJized  velocities  forms  the  tangent  space  to  C  which  we  denote  by 
TcC.  When  using  the  above  mentioned  coordinates  a  generalized  velocity 
^  cam  be  written  as  ^  =  (f,a;)-^  where  u  £  R^  and  w  G  iZ^  are  the  Linear 
and  angular  velocities  of  the  rigid  body  respectively.  The  cotangent  spaxre. 
T'C,  to  C  at  c  (that  is.  the  space  of  all  linear  functionals  of  TrC),  can 
be  identified  with  the  set  of  all  generalized  forces  that  can  be  exerted  on 
the  rigid  body.  A  generalized  force  rf  can  be  written  (always  with  respect 
to  the  above  mentioned  coordinates  in  C)  as  r?  =  {f,Tn)^,  where  f  £  R^ 
represents  a  force  and  m  E  R^  represents  a  moment  about  the  origin  of  the 
reference  frame.  For  a  planar  object  the  representations  still  hold  with  the 
obvious  differences  in  dimension  (the  torques  and  angular  velocities  are  one 
dimensional,  the  forces  and  linear  velocities  are  two  dimensional). 

We  will  only  be  concerned  in  this  paper  with  object-finger  contacts  which 
can  be  modeled  as  point  contacts  with  friction.  That  is,  the  fingers  will  be 
modeled  as  points  and  they  will  be  able  to  exert  forces  on  the  gripped  object 
within  the  cone  of  friction. 

The  forces  exerted  by  a  set  of  fingers  can  be  represented  by  a  3k- 
dimensional  vector  (/i, . . .,  A).  A  grip  transformation  for  k  fingers  holding 
a  rigid  body  is  a  map  G  :  fl^*  — '  R%=  T;C)  given  by 

k         k 

G(/i...../;c)  =  (E/.-E/.>^P<) 
1=1      1=1 

where  p,  is  the  coordinate  vector  of  the  i""'  gripping  point  in  the  body  coor- 
dinate frame.  For  a  set  of  k  fingers  holding  a  planar  body  the  grip  tansfor- 


mation  G  :  R?^  — ■  R^{=  T'C)  can  be  written  zs, 

h  k 

1=1  1=1 

where  jT,  designates  the  vector  obtained  from  p,  by  rotating  90°  counter- 
clocl<wise. 


3      Control  Approach 

Our  control  approach  involves  the  following  phases: 

(A)  Given  a  task  to  be  performed,  an  appropriate  combination  of  force  and 
position  targets  for  the  object  is  determined.  This  depends  on  the  force 
that  the  object  is  supposed  to  exert  on  its  environment  and  the  motions 
it  is  supposed  to  undergo  during  a  manipulation.  A  variety  of  different 
external-to-internal  force  relationships  are  possible  and  only  the  task 
to  be  accomplished  determines  the  relationship  which  is  appropriate. 
This  phase  takes  place  before  the  fingers  perform  any  motion. 

(B)  The  best  available  model  of  the  system  to  be  controlled  is  ajialyzed 
using  the  principles  of  mechanics,  leading  to  the  definition  of  a  suitable 
combination  of  force  and  position  targets  for  each  of  the  gripping  fin- 
gers, based  on  the  object  force/position  targets  computed  in  Phase  (A) 
and  on  additional  gripping  constraints.  This  phase  is  computationally 
intensive.  It  is  carried  out  after  the  fingers  have  gripped  the  object 
but  before  the  actual  manipulation  takes  place. 

(C)  Finally  there  is  an  iiinor  fcrdback  control  loop,  which  aims  to  keep  the 
finger  forces  and/or  jinsitions  aclnally  measurod  during  an  oxporiment 
close  to  their  target  values.  Provided  that  the  discrepancy  between 
model  and  actual  system  is  not  too  large,  this  causes  the  object  O 
to  follow  a  path  close  to  that  given  by  Phase  (A),  while  exerting  the 
desired  force  on  its  environment.  This  phase  is  run  in  real  time. 

Phase  (A)  is  essentially  the  general  force/position  control  problem.  Much 
research  treating  such  problems  has  been  done  (see,  [31], [32]  and,  for  a 
survey  [38]).  In  Phase  (B)  the  control  is  transferred  to  a  lower  level  where 
the  targets  for  the  individual  fingers  are  computed  depending  on  the  given 
grip  configuration  and  friction  constraints. 


Tlio  varioty  of  I  Ik-  rxt'Mii:il  forrp  In  inlrrnal-fnrrr>  rolat  ioimliips  l.liat  ran 
arihc  (luring;  I'hii.sc  (A)  is  readily  revealed  l)y  consideiiiitz;  a  lew  [jrot.olypical 
manipulation  ta-sks.  More  specifically  we  may  wish  to  perform  any  one  of 
the  following  tasks: 

(Tl)  Use  several  fingers  to  grip  a  freely  movable  object  O,  and  then  move 
O  along  a  specified  path  while  applying  grip  forces  of  user-specified 
intensity. 

(T2)  Apply  grip  on  an  object  0  lying  on  a  table-top,  and  exert  force  suffi- 
cient to  overcome  gravity  and  lift  the  object  (here  note  that  the  weight 
and  center  of  gravity  of  O  will  generally  not  be  known  in  advance). 

(T3)  Grip  an  object  O  constrained  by  various  hinges,  pegs  and  slots,  and 
move  it  along  the  unique  path  available  to  it. 

(T4)  Grip  the  handle  of  a  spring  loaded  crank  and  turn  it. 

In  (Tl)  we  must  try  to  hold  the  finger  forces  constant  (relative  to  the 
gripped  object).  In  (T2),  we  need  to  overcome  all  external  forces  and  at 
the  .same  time  adjust  tlie  (jrippiug  forces  so  as  to  avoid  slippage.  In  (T3) 
we  want  to  be  guided  by  external  forces.  In  such  problems  we  may  want 
either  to  keep  consl  raint-geiu-iated  forces  as  low  as  possible  or  to  have  them 
maintain  specified  positive  values  (or  values  lying  within  some  cone).  The 
first  option  applies  to  'two  sided'  problems  such  as  pushing  a  bead  along  a 
wire  and  opening  a  door  by  pulling  from  the  knob.  The  second  one  applies 
to  'one  sided'  wall  follonnng.  where  contact  with  a  guiding  wall  might  be  lost 
if  the  force  exerted  against  the  w^all  dropped  to  zero.  For  (T4)  yet  another 
relationship  is  needed.  Here  we  want  to  be  guided  by  external  forces  in  some 
directions  while  overcoming  the  external  forces  in  others.  Specifically,  we 
must  be  guided  by  the  component  of  the  external  force  which  is  normal  to 
the  trajectory  of  the  crank  knob  while  we  overcome  any  tangential  force 
generated  by  the  spring. 

In  general  the  primary  force  targets  with  which  Phase  (A)  analysis  begins 
will  be  forces  (and  torques)  at  the  reference  point  of  the  moving  object  O, 
defined  as  above  by  user-specified  functions  of  measured  external  forces,  or, 
even  more  simply,  by  user-specified  constants.  For  a  concrete  example  of 
this,  consider  three  fingers  holding  an  object  (tool)  O  that  is  to  be  pushed 
along  a  constraint  surface  (wall  or  edge)  W,  as  shown  in  Figure  1.  For 
simplicity  we  will  consider  the  case  of  an  object  moving  on  a  plane  (and 


make  the  appropriate  comments  for  the  three  dimensional  case).  We  assume 
that  there  is  no  friction  at  the  (unique)  contact  point  between  the  object  and 
the  surface,  but  do  assume  friction  at  the  finger-to-object  contacts.  In  the 
presence  of  object-to-wall  friction  wedging  might  occur  and  the  motion  is 
then  indeterminate  (see  [33]).  In  that  case  additional  assumptions  will  have 
to  be  made  to  carry  out  Phase  (A).  We  want  the  motion  of  this  composite 
system  to  be  guided  by  the  wall  (whose  precise  shape  is  not  known)  or,  rather 
by  the  external  force  E  generated  at  the  point  Q  of  object-to-surface  contact. 
Our  aim  is  to  keep  E  positive  (so  that  contact  with  the  wall  is  not  lost)  but  to 
prevent  E  from  growing  excessively  large.  These  two  considerations  imply  a 
target  value  for  E.  Moreover,  the  total  torque  r  on  the  object  (with  respect 
to  Q)  must  be  zero.  These  are  the  object  force  and  torque  targets  for  the 
manipulation  problem  depicted  by  Figure  1.  In  general,  this  force/torque 
target  is  indepondoiit  of  tiio  specific  gripping  configuration  of  the  fingers 
and  depends  only  on  the  task  to  be  performed  by  the  gripped  object.  In  the 
present  case  a  suital)lc  rrferonco  point  is  the  objort-to-wall  coiitart  point 
Q.  Moreover  the  f)l)j(<rt  coordinate  franio  ran  be  replaced  by  a  reference 
axis.  Any  axis  L  fixed  to  tiie  object  is  equally  suitable  as  a  reference  axis. 
Notice  that  we  are  implicitly  choosing  a  specific  hybrid  force/position  control 
approach  by  selecting  the  direction  normal  to  the  wall  as  the  one  to  be  force 
controlled.  We  then  retain  freedom  to  specify  the  motion  of  the  reference 
point  in  a  direction  tangent  to  the  wall.  The  motion  of  the  tool  will  then 
be  completely  determined  once  we  specify  its  target  orientation.  (We  may, 
for  example,  want  the  tool  to  maintain  a  constant  angle  with  the  constraint 
surface.)  For  this  we  need  to  estimate  the  tangent  direction  to  the  desired 
trajectory.  We  assume  here  that  the  manifold  W  is  smooth  (i.e.  without 
corners).  Suppose  W  is  m-dimensional,  and  /  independent  coordinates  along 
W  are  known  (at  least  in  the  vicinity  of  the  current  reference  point  position 
Q)  but  the  shape  of  W  in  the  remaining  dimensions  is  not  known.  (In  the 
planar  case,  m  =  1  and  /  =  0.)  Here  it  is  natural  to  command  the  fingers  to 
move  along  a  user  specified  curve  C  in  the  first  /  dimensions,  while  it  follows 
the  (unknown)  shape  of  the  manifold  W  in  the  remaining  dimensions.  The 
first  /  coordinates  of  Q,  are  then  known,  but  the  remaining  coordinates  must 

be  estimated.    We  can  use  a  few  successive  finger  positions  Pj ,  P^  to 

calculate  the  referonro  point  positions  Ql....,Q^  (see  Figure  2).  Notice 
that  the  (actual)  {\u<^nr  positions  Pj, ...,/'_;'  can  be  conipnled  from  the 
commanded  finger  positions  P,' . . . . ,  P^  and  the  (known)  matrix  K  of  finger 


stiffnesses  using  the  formula 

F  =  K{Pa  -  Pc).  (1) 

If  the  fingers  are  decoupled,  the  matrix  K  is  in  fact  block  diagonal  with  the 
blocks  being  the  stiffness  matrices  K,  for  the  individual  fingers  (Figure  3). 

We  then  fit  a  suitable  curve  to  this  data  and  use  this  curve  to  estimate 
the  amount  that  the  last  A^  -  I  coordinates  of  Q  must  change  to  remain  on 
the  surface  W  when  the  first  /  coordinates  make  a  step  of  a  given  size  (here 
N  is  the  dimension  of  the  vector  Q).  The  change  in  the  first  /  coordinates  of 
Q  should  be  taken  from  a  user-specified  path  C  =  C{Q),  which  is  of  course 
a  curve  parametrized  by  time.  This  concludes  the  analysis  of  Phase  (A). 

For  Pha^e  (B)  we  need  to  relate  the  object  force/torque  target  to  the 
required  finger-force  target  vector  F  =  (^1,^2,^3)  (where  the  subscripts 
correspond  to  the  fingers).  This  step  is  independent  of  the  task  to  be  per- 
formed. (It  only  depends  on  the  target  force/torque  vector  (E,  t)  established 
for  the  task  and  the  gripping  positions  of  the  fingers  which  must  perform  the 
task.)  This  corresponds  to  finding  a  right  inverse  for  the  grip  transforma- 
tion G  defined  in  Section  2.  Given  the  target  force  E  and  torque  r  (which 
is  assumed  to  be  zero  in  the  present  case)  the  total  of  the  finger  forces  must 
be  in  equilibrium  with  E,  and  the  total  torque  on  the  object  (with  respect 
to  Q)  must  be  zero.  This  gives  two  equations: 


Y^Fi^E,  X^i^,f,  =  0       (2-D) 

i=l  1=1 

3  3 

J2F  =  E,  ^F.xr,  =  0     (3-D) 


t=i  >=i 

where  r,  is  the  relative  position  of  the  z"'  finger  with  respect  to  Q.  For  k 
fingers  in  2-dimensional  space  it  gives  3  equations  with  2k  unknowns.  For  k 
fingers  in  3-dimensional  space  this  gives  6  equations  in  3k  unknowns. 

Several  supplementary  inequalities  must  be  satisfied  if  slip  is  to  be  avoided 
at  every  point  at  which  grip  is  being  maintained  frictionally.  (In  our  example 
these  are  the  three  finger-to-object  contact  points  P,,i  =  1,2,  3.)  Specifically 
the  force  F,  exerted  at  the  point  Pi  must  lie  within  the  corresponding  cone 
of  friction  C,  (see  Figure  1),  which  can  be  estimated  using  the  relevant  coef- 
ficients of  friction  and  contact-point  tangent  directions.  (In  our  planar  case 
this  gives  6  linear  inequalities  which  the  finger-force  vector  F  must  satisfy.) 
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The  target  finger-force  vector  F  —  {Fi.F^.Fz)  must  be  chosen  in  a  manner 
satisfying  all  these  conditions.  Moreover,  the  finger  forces  are  necessarily 
bounded.  The  bounds  depend  on  the  maximum  force  the  fingers  can  exert 
and  the  majcimum  force  the  gripped  object  can  tolerate  without  breaking. 

These  conditions  restrict  F  to  the  interior  of  a  convex  region  R  defined 
by  {E^T^.  However,  to  allow  for  inevitable  inaccuracies  in  our  model  and 
control,  we  need  to  find  a  target  F  lying  at  the  center  of  a  sphere  (or,  if  more 
convenient,  an  ellipsoid,  a  cube  or  other  polyhedron)  5  of  size  somewhat 
exceeding  the  largest  plausible  force  deviation;  this  sphere  S  must  lie  entirely 
within  the  region  R.  It  is  reasonable  to  let  F  be  the  smallest  force  vector 
(in  magnitude),  for  which  there  exists  a  sufficiently  large  sphere  5  of  this 
kind  (see  Section  5  for  the  details  of  these  computations).  This  determines  a 
force  transformation  V  that  maps  object  forces  and  torques  to  finger  forces. 

The  calculations  just  described  comprise  Phases  (A)  and  (B)  of  our  con- 
trol approach,  which  are  performed  jirioT  to  the  start  of  motion  of  the  ob- 
ject gripped  by  the  fingers.  This  computation  yields  a  transformation  U 
that  maps  a  given  object  force/torque  target  vector  {{E,  r))  to  a  finger  force 
target  vector  (F).  We  then  proceed  as  follows  (Phase  (C)).  The  force  ac- 
tually applied  by  each  finger  is  measured,  giving  a  comprehensive  measured 
force  vector  F^.  This  in  turn  gives,  via  the  grip  transformation,  an  object 
measured  force/torque  vector  [E-m,  r^)  at  the  reference  point.  Given  a  nom- 
inal (or  commanded)  position  Qc  of  the  reference  point,  the  reference  point 
would  actually  have  moved  to  the  point  Q^  on  O's  surface  of  constraint 
which  minimizes  the  elastic  energy  of  the  system  (see  Figure  3).  (We  are 
assuming  that  there  is  no  friction  between  the  tool  and  the  wall.) 

The  force  Em  will  then  be  proportionaJ  to  Qc  —  Qa-  Hence  if  the  reference 
point  (object)  is  commanded  to  move  cdong  the  vector  Em,  the  point  Qa 
will  not  change.  This  same  remark  applies  to  any  other  force  vector  E 
perpendicular  to  the  constraint  manifold  W  at  the  point  Qa-  If  our  system 
model  is  accurate  enough,  it  is  reasonable  to  treat  the  target  force  F  as  an 
equilibrium  system  of  forces  (i.e.  as  representing  an  equilibrium  not  only 
for  the  model,  but  also  for  the  actual  system).  Under  this  assumption  the 
difference  vector  E  —  Em  is  also  orthogonal  (or  very  nearly  orthogonal)  to 
the  constraint  wall  W  at  Qa-  Hence  an  appropriate  motion  of  the  reference 
point  in  the  direction  of  the  vector  E  —  E-m  wiU  reduce  the  force  error  E-E-m 
(nearly)  to  zero. 

The  preceding  remarks  apply  to  situations  in  which  external  forces  are 
either  absent  (case  of  freely  moving  gripped  objects),  or  are  only  used  for 
guidance  (wire  or  wall  tracking). 


A  similar  analysis  can  be  done  in  cases  where  external  forces  and  torques 
may  be  present  but  are  to  be  resisted  by  the  forces  which  the  fingers  apply. 
We  can  still  apply  the  control  scheme  consisting  of  the  three  Phases  (A),  (B) 
and  (C)  in  this  more  general  case,  with  the  difference  that  the  target  force/torque 
vector  {E,  r)  in  Phase  (A)  must  now  be  defined  as  a  function  of  the  external 
force  and  torque  measured  (in  the  manner  described  earlier)  by  the  gripping 
fingers.  This  again  is  done  before  the  actual  manipulation  starts. 

Suppose,  for  example,  that  we  want  to  lift  an  object  affected  by  gravity 
off  a  table  top.  As  lift  begins,  a  steadily  increasing  external  force  (acting  at 
the  initially  unknown  center  of  gravity  of  the  object)  will  be  experienced,  and 
one  might  need  to  increase  the  gripping  force  at  the  finger  tips  to  prevent  slip. 
Assume  that  the  external  force  and  torque  applied  to  the  gripped  object  are 
{E,  t).  (These  are  also  the  force  and  torque  targets  given  by  Phase  (A).)  The 
mechanical  analysis  of  the  object/finger  system  (Phase  (B))  given  previously 
continues  to  apply  under  this  assumption,  except  that  now  the  equilibrium 
conditions  for  the  force  and  torque  become: 

3  3 

1=1  t=i 

3  3 

^F.  =  £,    ^2^'^"-'  =  ^    (3-D) 
1=1  1=1 

where  r,  is  the  relative  position  of  the  i""  finger  with  respect  to  the  nominal 
center  of  torque  and  (E,  r)  is  the  measured  force/torque  at  a  reference  point 
on  the  object.  (With  the  notation  of  Section  2  this  is  G{F)  =  (E,t).) 

Control  Pha^e  (C),  which  servoes  to  the  target  forces  and  to  a  user- 
specified  geometric  path,  carries  over  without  change  from  our  preceding 
discussion. 

In  Section  5  we  derive  some  of  these  calculations  in  detail  for  the  case  of 
three  (planar)  fingers  holding  a  rigid  object. 

4      Comparison  with  other  methods 

Much  research  in  robot  force  control  has  been  reported  since  the  appearance 
of  the  first  remote  manipulators  (see  [38]  for  a  good  survey).  The  work  on 
hybrid  position/force  control  presented  in  [32]  is  particularly  relevant  to  our 
approach.  It  is  essentially  this  method  that  we  used  to  compute  the  object 
targets  (forces  and  positions)  for  a  given  task. 
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Since  it  has  become  clear  that  more  dexterity  than  that  provided  by 
simple  grippers  is  desirable  the  problems  of  dextrous  manipulation  have 
recently  started  receiving  more  attention.  Several  studies  on  multifingered 
grippers  have  been  reported  ([4],  [18],  [5]). 

The  surging  level  of  research  devoted  to  dextrous  manipulation  is  encour- 
aged by  the  availability  of  sophisticated  research  tools  like  the  Stanford/ JPL 
hand  ([22]),  the  Okada  hand  ([29,28])  and  the  Utah/MIT  hand  ([14,13]). 

As  mentioned  above  one  of  the  central  issues  in  object  handling  is  the 
relationship  between  the  external  forces  and  torques  acting  on  the  object  and 
the  forces  and  torques  acting  on  the  individual  fingers.  Several  approaches 
have  been  presented  in  the  literature  for  managing  this  relationship.  The 
notion  of  grip  Jacobian  is  presented  in  [35].  This  is  a  matrix  that  transforms 
the  individual  finger  forces  into  the  (gripped)  object  force  and  torque  for 
a  given  grip  configuration.  For  three  fingers  holding  an  object  in  three 
dimensions  the  matrix  is  6  X  9.  This  leaves  a  three  dimensional  null  space 
from  which  to  choose  the  finger  gripping  forces.  In  regard  to  this  problem, 
Salisbury  suggests  specifying  the  magnitude  of  the  components  of  the  finger 
forces  along  the  lines  joining  pairs  of  fingers.  This  expands  the  matrix  to 
9x9  allowing  it  to  be  inverted.  Much  the  same  grip  transformation  is 
described  in  [11]  but  a  method  is  also  given  which  avoids  the  inversion. 

Yoshikawa  and  Nagai  ([39])  describe  the  concepts  of  grasping  and  ma- 
nipulating forces  particularly  clearly  and  give  a  method  for  decomposing 
the  fingertip  forces  into  manipulating  forces  and  grasping  forces.  Kobayashi 
([16])  develops  a  control  strategy  for  a  3-finger,  12-joint  hand  ([10]),  along 
similar  lines.  The  problem  of  distributing  forces  among  the  grasping  fingers 
is  also  addressed  in  [19],  [18]  and  (in  the  context  of  multilegged  locomotion) 
[30]. 

Our  method  for  choosing  the  gripping  forces  is  closely  related  to  the  work 
in  [39].  We  select  a  point  of  concurrence  for  the  finger  forces  in  such  a  way 
as  to  minimize  the  grip  dependence  on  friction  (see  below  for  details).  This 
is  just  one  of  various  criteria  that  can  be  used  to  select  the  most  suitable 
set  of  finger  forces.  Generally  one  would  like  to  make  the  purely  gripping 
forces  as  small  as  possible,  as  long  as  slippage  of  the  fingers  is  avoided. 
Different  ways  of  measuring  the  gripping  forces  were  suggested.  In  [9],  the 
magnitude  of  the  grasping  force  is  defined  as  the  square  root  of  the  area 
of  the  triangle  formed  by  the  individual  finger  forces.  Another  proposed 
scheme  ([15])  consists  of  minimizing  the  norm  of  the  finger  forces  under 
certain  approximated  frictional  constraints.  Task  oriented  optimal  grasping 
was  analyzed  in  [20]. 
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For  more  complicated  finger  contact  models  (soft  fingers,  rounded  tips), 
a  more  detailed  analysis  of  the  contact  geometry  is  required.  Kobayashi 
in  [16,17]  introduces  the  concept  of  passive  joints  to  describe  the  contact 
between  finger  and  object  in  a  homogeneous  way.  Cutkowski  et  al.  in  [3,2] 
analyze  the  gra^p  stiffnesses  for  a  pair  of  soft  fingers  holding  an  object.  They 
then  use  their  ancdysis  to  study  the  situations  which  might  lead  to  finger 
slippage. 

5      Kinematic  Transformation  Details 

We  now  describe  the  transformations  used  to  implement  the  manipulation 
ideas  mentioned  above.  We  will  first  deal  with  the  case  of  several  fingers 
moving  on  a  plane  (which  is  the  case  that  applies  to  the  NYU  FFM). 

Assume  there  are  k  fingers  gripping  an  object  0.  We  let  /\, . .  .,F/t  be 
the  vector  of  forces  applied  by  the  individual  fingers.  Given  the  external 
force  E  and  torque  r  acting  on  the  object  O,  finding  the  corresponding 
force  on  the  individual  fingers  is  a  matter  of  solving  the  equation 

Y.F.  =  E,        X]/;^r.  =  r  (2) 

where  r,  is  the  vector  from  the  nominal  center  of  torque  to  the  position  of 
the  i"'  finger,  and  x  designates  the  vector  obtained  from  x  by  rotating  90° 
counterclockwise. 

Using  the  definition  of  the  grip  transformation  G  and  introducing  vectors 
F  —  {Fi, . . . ,  Fk)  and  w  =  (E,  r),  we  can  write  them  as 

G{F)  =  w.  (3) 

We  now  seek  a  right  inverse  for  G  that  will  give  us  finger  forces  satisfying 
the  frictionaJ  constraints.  The  linear  transformation  G  maps  the  set  of 
vectors  F  onto  the  set  of  object  force/torque  vectors  w.  We  assume  we  have 
three  noncolinear  gripping  points,  so  G  is  of  full  rank.  Hence  G  has  the 
pseudoinverse  G"*"  =  G^{GG^)~^,  and  the  solutions  to  Equation  3  can  be 
written  as 

G+w  +  e,  (4) 

where  e  is  a  solution  of  the  homogeneous  equation  Ge  =  0.  The  vector  e 
could  be  considered  a  set  of  purely  gripping  forces  which  hold  the  object 
in  equilibrium  (see  [39]).    It  is  not  true  though,  that  any  solution  of  the 
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homogeneous  equation  will  in  fact  grasp  the  object.  (If  e  is  a  non-trivial 
solution  which  grasps  the  object,  then  -e  is  aJso  a  solution  and  it  will  not 
grasp  the  object.)  The  vector  e  should  therefore  be  chosen  so  that  a  grip  is 
achieved  and,  furthermore,  so  that  finger  slip  is  avoided. 

We  choose  the  equilibrium  vector  e  —  {ci, . .  .,ek)  hy  first  precalculating 
a  fixed  equilibrium  vector  e  and  putting  e  =  ae.  The  constant  a  of  propor- 
tionality must  be  large  enough  to  ensure  that  all  the  individual  finger  force 
targets  determined  by  (4)  avoid  slip.  An  appropriate  choice  of  q  for  our 
situation  was  made  experimentally.  We  determine  the  equilibrium  vector  e, 
assuming  that  three  fingers  are  involved  and  that  the  tangent  vectors  at  the 
points  of  grip  are  known. 

The  two  equilibrium  conditions  that  constrain  the  e,'s  are 

^e.  =  0,        $:err.  =  0.  (5) 

In  order  to  narrow  the  search  for  the  gripping  forces  we  impose  additional 
constraints.  We  will  look  for  forces  whose  lines  of  action  intersect  at  one 
point  and  then  choose  a  suitable  such  point.  We  proceed  as  follows.  We 
find  all  the  points  p  such  that  all  the  lines  through  p  and  the  gripping  points 
make  equal  angles  6  with  the  corresponding  normals.  (We  assume  the  same 
friction  coefficients  at  all  the  gripping  points).  Then,  we  select  the  point  for 
which  6  is  mirumum,  as  the  point  of  concurrence  of  the  three  forces.  This 
will  give  equilibrium  forces  which  lie  in  the  smallest  possible  cone  of  friction 
(that  will  prevent  slippage).  The  components  of  e  are  then  determined  up 
to  a  constant  factor  by  the  condition  that  the  three  forces  acting  along  these 
lines  should  sum  to  zero. 

Let  t,  be  the  tangent  to  the  gripped  object  O  at  the  z"'  gripping  point  r,. 
The  point  p  of  concurrence  of  the  force  vectors  at  the  three  gripping  points 
satisfies 

{p-r,f{fion,  +  U)  =  0,i=  1,2,3  (6) 

for  some  appropriate  constant  ^o  (=  tan^).  We  want  the  smallest  //q  for 
which  the  above  equations  have  a  solution.  Putting  7,  =  —rfrii,  rji  =  —rjti. 
Equation  6  can  be  written  as 

P^(/'on,  +  U)  -  -(/io7.  +  Vi)-  (7) 

Hence  the  (generalized)  vector  P  =  (pi,p2>  1)'^  satisfies  the  equation 

P^(A/  -  /XoM)  =  0  (8) 
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where  M  (resp.  JT)  is  the  matrix  whose  successive  rows  are  (f,x,  <.y, »?:), 
i-  1,2,  3  (resp.  (-n,x, -n,y, -7,),  t  =  1,2,3).  This  is  an  eigenvalue  problem 
where  /io  is  the  eigenvalue  and  P^  is  the  eigenvector.  However  since  the  side 
of  the  normal  on  which  p  lies  is  not  known,  this  (generalized)  eigenvalue 
equation  must  also  be  solved  with  the  second  and  third  rows  of  M  changed 
(independently)  to  their  negatives  (four  patterns  in  all).  The  real  eigenvalue 
with  the  smallest  absolute  value  should  be  used  to  determine  p.  Such  an 
eigenvalue  exists  if,  for  example,  the  n,'s  are  not  all  in  one  half  plane  (in 
that  case  M  is  invertible). 

Once  p  and  fio  are  determined  the  three  equilibrium  forces  are  simply 
€,(n,  -  Hot,),i  =  1.2,3,  where  the  positive  constants  e,  must  be  chosen  to 
satisfy 


J2^dn.-fiJi)  =  0,        5^e.  =  l.  (9) 

If  more  than  three  fingers  are  involved  in  gripping  the  object,  we  can 
form  all  subsets  of  three  fingers,  use  the  calculation  just  explained  to  find 
an  equilibrium  vector  for  each  such  subset,  and  then  form  some  suitable 
convex  combination  of  these  equilibrium  vectors,  e.g.  by  averaging. 

Notice  that  similar  calculations  hold  for  the  case  of  three  fingers  in  ma- 
nipulating a  three  dimensional  object  since  the  concurrence  point  must  still 
lie  on  the  plajie  determined  by  the  contact  points. 

Both  the  matrix  G  and  the  equilibrium  vector  e  need  only  be  computed 
once  during  the  manipulation  as  long  as  the  grip  points  do  not  change. 
To  see  this  let  us  consider  the  way  in  which  Equation  2  and  its  solutions 
vary  when  the  gripped  object  rotates.  Let  i2  be  a  rotation  matrix.  Such  a 
rotation  changes  Equation  2  into 


which  can  be  written  as  G{pi(R)F)  =  p2{R)w,  where 

Pi{R)F  =  priR)iFr,...,Fk)  =  iR'^Fu...,R'^F,)  (11) 

and 

P2iR)w  =  p{R){E,  t)  =  {R^E,  t).  (12) 

Hence  (10)  has  the  solution 

F  =  p^{R)-^G^P2{R)w.  (13) 
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The  matrix  G"*"  depends  only  on  the  positions  of  the  fingers  relative  to 
the  norainaJ  center  of  torque  and  can  be  calculated  as  soon  as  grip  is  estab- 
lished and  the  position  of  the  center  of  torque  is  known.  A  similar  calculation 
holds  in  R^  with  />2  replaced  by  p^,  where  P3(R){E,t)  =  {R^ E,  R^t).  It 
should  be  noted  cdso  that  the  calculation  (13)  only  requires  a  few  multipli- 
cations by  matrices.  Since  the  torque  component  of  w  is  invariant  under 
P2{R)-,  it  contributes  only  a  fixed  vector  to  G'^p2{R)'w  and  this  vector  can 
be  computed  as  soon  as  grip  is  established.  The  remainder  of  (13)  can  be 
computed  using  a  total  of  k  +  1  multiplications  by  2  X  2  matrices. 

Note  also  that  to  avoid  dealing  explicitly  with  rotation  matrices,  all 
vectors  which  rotate  with  the  gripped  object  (like  the  components  of  the 
equilibrium  force  vector  e)  can  be  expressed  as  linear  combinations  X2'^»'"» 
of  grip  points.  For  vectors  which  are  invariant  under  translations  (such  as 
force  vectors)  we  choose  a,'s  such  that  Yl  ^t  =  0.  For  relative  position  vectors 
(which  both  rotate  and  translate  with  the  object)  we  choose  a^'s  such  that 

6      Description  of  FFM 

The  Four  Finger  Manipulator  (FFM)  is  a  simple  two  dimensional  robot  de- 
signed and  fabricated  at  the  NYU  Robotics  Laboratory  to  study  dextrous 
manipulation  and  problems  associated  with  real  time  control  and  manip- 
ulation. A  schematic  representation  of  the  system  (top  view)  is  shown  in 
Figure  4. 

The  FFM  consists  of  four  identical  and  independently  controllable  fingers 
(see  Figure  5)  that  are  mounted  on  the  four  sides  of  a  square  table. 

Each  finger  can  be  moved  in  the  xy-pla.ne  with  the  aid  of  two  stepper 
motors  that  are  connected  to  the  finger  through  a  system  of  carriages  and 
links.  In  all  the  robot  has  eight  degrees  of  freedom  (2x4  fingers).  Each 
finger  is  compliant,  and  has  two  pairs  of  strain  gauges  that  enable  it  to 
sense  the  x  and  y  component  of  the  force  acting  on  the  finger.  The  accuracy 
of  the  strain  gauges  is  about  0.01  N.  Each  of  the  eight  stepper  motors  is 
controlled  by  an  INTEL  80SS  processor  and  has  a  position  encoder  attached 
to  it.  These  processors,  along  with  the  other  precision  components  provide  a 
position  accuracy  of  about  0.001  cm.  Together,  the  strain  gauges  and  motor 
encoders  provide  all  the  information  required  for  force/position  control  of 
the  system.  The  mounting  table  can  be  tilted  to  perform  experiments  in  the 
presence  of  gravity. 
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The  host  computer  for  the  FFM  is  a  SUN  workstation  with  a  Motorola 
68000  processor  running  the  UNIX^  operating  system.  This  workstation 
serves  as  the  primary  system  for  software  development,  data  storage,  con- 
troller and  data  analysis.  The  FFM  also  has  a  lower  level  controller  also  with 
a  68000  processor  running  the  NRTX  operating  system.  NRTX  is  a  real  time 
version  of  UNIX  that  provides  several  features  for  real  time  processing  such 
as  preemptive  scheduling,  multitasking,  host  controller  commuiucation  etc. 
The  lower  level  controller  communicates  with  the  finger  motors  and  strain 
gauges.  The  architecture  block  diagram  of  the  FFM  system  is  shown  in 
Figure  6.  The  use  of  a  multiprocessor,  such  as  the  NYU  Ultracomputer  [8], 
could  increase  the  speed  of  the  system  by  distributing  the  various  compu- 
tational tasks  involved.  Such  an  approach  will  be  implemented  in  the  near 
future. 

The  FFM  software  incorporates  various  data  analysis  facilities.  Informa- 
tion (forces,  positions,  etc)  is  stored  in  frames  at  each  cycle  of  execution,  and 
these  frames  can  be  archived  to  the  host  computer.  This  archived  data  can 
then  be  interpreted  using  an  extensive  data  analysis  package.  The  graphs 
shown  were  obtained  using  this  package. 

Details  of  the  system  software  architecture  are  given  in  [6].  A  full  de- 
scription of  the  FFM  is  given  in  [12].  Kinematic  transformations  for  an 
individual  finger  are  given  in  Appendix  A. 

7      Experimental  results 

We  now  describe  a  few  of  the  experimental  results  obtained  so  far.  These 
include  results  on  door  opening  by  holding  a  knob,  and  wall  following  with 
a  gripped  tool. 

The  2-D  'door'  used  in  our  experiments  is  shown  in  Fig.  7.  It  has  a 
revolving  knob  and  is  hinged  to  a  base  and  placed  arbitrarily  in  the  robot 
workspace.  It  is  assumed  that  no  external  forces  are  acting  on  the  sys- 
tem (springs,  load,  etc.).  The  center  of  rotation  is  unknown  to  the  control 
software. 

We  choose  the  center  of  the  disk  as  a  reference  point.  Treating  the 
gripped  knob  as  a  virtual  finger  simplifies  the  problem  to  that  of  moving  the 
center  of  the  knob,  while  rotating  the  knob  appropriately.  The  algorithm 
for  determining  the  motion  of  the  center  uses  the  approach  described  earlier. 
We  want  to  move  in  the  direction  tangent  to  the  circle  described  by  the  knob 
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and  keep  the  force?  in  the  normal  direction  to  a  minimum. 

Figures  8  to  9  give  experimental  data  generated  using  the  control  scheme 
described  earlier.  Figure  8  shows  the  forces  on  the  reference  point  aJong  the 
trajectory.  As  soon  as  the  force  reaches  the  threshold  value  of  1  N  the 
robot  makes  a  correction  in  the  estimate  of  the  tangent.  Figure  9  shows 
the  estimated  tangent  along  the  trajectory  at  various  points.  It  can  be  seen 
from  Figure  8  that  once  the  forces  build  up  past  the  threshold,  the  robot 
moves  in  such  a  way  as  to  make  corrections  in  the  estimated  tangent  as  well 
as  to  reduce  the  total  force  buildup  on  the  reference  point. 

The  system  of  three  fingers  adjusts  after  each  cycle  to  maintain  the  grip 
and  sustain  the  normal  forces  exerted  by  the  door.  The  force  behavior  of 
each  finger  is  different  due  to  their  different  locations  with  respect  to  the 
door.  Figure  10  shows  the  forces  on  each  finger.  The  inner  control  loop 
adjusts  the  fingers  to  give  the  desired  end  result.  The  forces  on  each  finger 
remain  within  safe  limits  of  about  3  N.  In  fact  values  mostly  stay  between 
0.5  and  1.5  N,  which  is  the  expected  variation  due  to  the  force  threshold 
value  used. 

The  configuration  for  the  wall  following  experiment  is  shown  in  Fig- 
ure 11.  The  relative  position  of  the  'tip'  of  the  tool  (the  contact  point)  with 
respect  to  the  fingers  is  known  but  the  shape  of  the  wall  is  unknown.  The 
desired  contact  force  was  1.2  Newtons.  The  corresponding  data  is  shown  in 
Figures  12  and  13. 

8      Future  Work 

We  will  extend  our  research  in  dextrous  manipulation  to  three  dimensions 
by  applying  the  approach  described  above  to  the  Utah/MIT  hand.  This 
sophisticated  3-D  hand  presents  many  new  challenges  but  it  also  offers  much 
more  experimental  flexibility.  To  guide  our  general  research  approach  we 
have  developed  a  list  of  prototypical  manipulation  tasks  for  this  hand. 

Most  manipulation  tasks  involve  two  steps:  (a)  acquiring  a  grasp,  and 
(b)  manipulating  the  object  once  grasped  .  Step  (a)  can  be  broken  into  the 
following  substeps: 

i.  locate  the  object 

ii.  choose  a  grasp  (if  the  number  and  shape  of  the  objects  to  be  manipu- 
lated is  limited,  as  in  many  industrial  environments,  this  can  be  table 
driven)(see  [5]). 
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iii.  grasp  the  object. 

We  expect  our  work  to  concentrate  on  studies  of  step  (b),  though  the 
prior  problem  of  grasp  acquisition  is  under  active  study  in  our  laboratory 

([23],  [1],  [36])  and  elsewhere  ([25],  [26],  [24],  [27],  [21],  [37],  [4],  [34],  [35]). 
Here  is  a  sample  of  the  list  of  the  3-D  tasks  to  be  studied: 

1.  Grasp  a  convex  object  with  3  or  4  fingers,  the  strength  of  the  grip 
being  specified,  and  move  it  along  a  specified  path. 

2.  Same  as  above,  but  attain  continuing  motion  by  repeatedly  removing 
one  finger  from  the  object  and  repositioning  it. 

3.  Grasp  and  lift  a  body  of  unknown  weight,  grip  appropriately  as  the 
weight  is  sensed.  Deduce  the  weight  of  the  body  once  it  is  lifted. 

4.  Maintciin  grasp  on  a  body  being  moved  by  external  forces. 

5.  Grasp  a  convex  object,  and  slide  one  point  of  it  along  an  external 
obstacle. 

6.  Grasp  a  bottle-cap-like  object,  and  pull  it  off  the  fixture  to  which  it  is 
attached. 

7.  Screw  a  large  nut  onto  a  bolt  with  a  steeply  pitched  thread. 

8.  Insert  a  peg  into  a  hole  which  fits  it  rather  tightly. 

9.  Start  a  nut  on  a  bolt. 

10.  Write  on  a  wall  with  a  slightly  flexible  pencil,  and  calibrate  the  com- 
pliance of  the  pencil. 

11.  Screw  in  a  light  bulb. 

12.  Use  a  screwdriver  to  drive  in  an  (already  started)  long  screw. 

13.  Use  a  screwdriver  to  pry  off  the  top  of  a  paint-can  lid. 

14.  Grip  the  handle  of  a  hammer,  and  use  it  to  pound  in  a  peg. 

15.  Grip  a  wooden  match,  and  light  a  flame. 

16.  Typewrite  on  a  computer  keyboard. 
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17.  Assemble  jigsaw-puzzle  pieces. 

18.  Roll  a  cylinder  using  two,  three,  and  four  fingers. 

19.  Turn  a  crank  of  unknown  radius. 

20.  Pick  up  a  peg  with  a  pincer  and  insert  it  into  a  hole. 

21.  Throw  a  ball  through  the  air  or  roll  it  over  a  flat  surface  by  giving  it 
an  initial  push  (weight  unknown). 

These  tasks  can  be  classified  in  various  helpful  ways.  The  following  are 
some  preliminary  classification  parameters. 

1.  Can  the  task  be  performed  using  only  the  fingers,  or  is  a  wrist  neces- 
sary, or  is  an  arm  necessary?  Initially  we  plan  to  concentrate  on  tasks 
requiring  only  fingers,  since  this  will  require  less  infrastructure  at  the 
beginning. 

2.  Number  of  degrees  of  freedom  that  are  position  controlled  vs.  number 
of  degrees  of  freedom  that  are  force  controlled. 

3.  What  role  does  friction  play  in  the  problem?  Is  it  irrelevant,  as  in  the 
case  of  a  positive  grip,  or  must  it  be  taken  into  account?  (Friction 
may  be  irrelevant  over  the  entire  range  of  coefficients  of  friction  (0  to 
infinity),  or  just  for  sufficiently  small  or  sufficiently  large  coefficients). 

4.  Are  the  (force  and/or  position)  constraints  on  the  problem  time  vary- 
ing (rheonomic)  or  time  invariant  (schleronomic)?  If  variable,  do  they 
vary  slowly  enough  that  the  algorithm  can  treat  them  as  constant,  or 
are  they  abrupt  (as  in  the  occurrence  of  corners  during  edge  following, 
or  in  catching  a  dropped  object,  or  in  pulling  a  plug)? 

5.  Are  the  environmental  constraints  holonomic  (as  with  a  rigidly  held 
object)  or  not  (for  a  sphere  held  between  two  planes)? 

We  will  concentrate  initially  on  tasks  that  may  be  performed  efficiently 
using  only  force/position  control  derived  from  built  in  Utah  hand  sensors, 
but  do  intend  to  incorporate  other  sensor  information  later  (vision,  tactile). 
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A      Details  of  FFM  Kinematics 

One  coordinate  frame,  so  called  the  private  coordinate  frame,  is  associated 
with  each  finger.  This  frame  has  its  origin  at  the  center  of  the  base  segment 
of  that  finger  (Figure  14).  Its  i-axis  is  parallel  to  the  associated  finger  base 
segment  with  its  positive  direction  pointing  to  the  right.  The  positive  y 
direction  of  each  private  coordinate  frame  always  points  to  the  center  of  the 
table. 

Let  P,  =  (Pix,Piv)'^  be  the  top  of  the  finger  tip  position  of  the  i""  finger 
in  its  private  coordinate  frame.  Let  P,c  =  (PucPtyc)'^  be  the  top  of  the 
finger  tip  position  of  the  z''^  finger  in  the  global  coordinate  frame.  Let 
M,  =  (m,;,m,>)  be  the  vector  of  left  and  right  motor  positions  of  the  {"" 
motor  pair  (which  is  associated  with  the  z"'  finger)  in  the  z"'  finger  private 
coordinate  frame. 

Using  these  notations  and  with  the  skeleton  of  the  finger-linkage  as  in- 
dicated in  Figure  14,  the  forward  kinematics  of  the  z''*  finger  can  be  written 
as: 


(m,-;  +  m,>) 


(14) 


P.,     =     R(9,)P,  +  T,  (16) 

The  inverse  kinematics  of  the  z'''  finger  is  then  described  by  the  following 
equations: 

P.     =     P(-^,)[P.,-T,]  (17) 

m,i     =    p.x  -  I  -  y/a]  -  b.y  "  (b.  +  d,)]^  (18) 

m.,     =     p.x  +  I  +  \/a?  -  [P,y  -  (b,  +  d,)]^  (19) 
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In  these  equations 

a,  =  the  length  of  the  leg  of  the  i*''  finger. 
6,  =  the  length  of  the  arm  of  the  i"'  finger. 

a  =  the  distance  between  the  center  of  the  two  gears  in  the  gear  head 
of  the  i"'  finger. 

di  —  the  offset  in  the  hinge  that  connects  the  leg  to  the  ball  nut  of  the 


^th. 


finger. 


R{e,: 


is  the  rotation  matrix  of  the  i^^  finger. 


cos(^,)     -sin(^,) 
sin(^,)     —  cos(^,) 

T,  =  {xoffset,,yoffset,)  is  the  translation  vector  of  the  i^^  finger. 
i  =  1,2,3, 4.  is  the  index  of  the  fingers. 


0 

2 


i  =  1 

i  =  2 

i  =  3 

I  =  4 

0         i=l,3 
-^^       i=2 

i  =  1 
?  =  2,4 
z  =  3 
^side  =  the  length  of  the  base  segment  parallel  to  the  x-axis. 
and 

Uside  =  the  length  of  the  base  segment  parallel  to  the  y-axis. 
Letting  Pc  =  [  Pi xc    Piyc    Pixc    Piyc    Pzxc    Pzyc    Paxc    P4yc  ]-^  and  P  = 
[  Pii    Ply    P2r    P2y    P3x    P3y    Pax    P4y  ]^,  equations  16  and  17  Can  be  ex- 
pressed in  the  following  matrix  forms: 


''offset,  — 


Voffset,   — 


2 

2 
0 

2 


Pr        = 


1 

0 

0 

0 

0 

0 

0 

0 

"  Plx 

0 

1 

0 

0 

0 

0 

0 

0 

Ply 

0 

0 

0 

1 

0 

0 

0 

0 

P2x 

0 

0 

-1 

0 

0 

0 

0 

0 

P2y 

0 

0 

0 

0 

-1 

0 

0 

0 

P3x 

0 

0 

0 

0 

0 

-1 

0 

0 

P3y 

0 

0 

0 

0 

0 

0 

0 

-1 

P4x 

0 

0 

0 

0 

0 

0 

1 

0 

.  P4y 

0 
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2 

_  X,,d, 

2 
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Viidc 
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x,,d^ 

2 
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These  are  the  basic  relations  used  in  our  kinematic  computations. 
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Figure  1:  Wall  following  with  a  tool 
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Figure  2:  Estimate  of  tangent. 


Figure  3:  Actual  and  commanded  positions 
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Figure  4:  Layout  of  the  FFM. 
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Figure  5:  Architecture  of  a  single  finger. 
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Figure  6;  The  Architecture  Block  Diagram  of  the  FFM  system. 
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Figure  S:  Forces  at  the  reference  point. 
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Figure  9:  Estimates  of  the  tangent  direction. 
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Figure  10:  Finger  forces 
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Figure  11:  Wall  Following 
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Figure  12:  Contact  Force 
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Figure  13:  Finger  Forces 
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Figure  14:  The  skeleton  of  a  finger-linkage. 
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